User-controlled 3d simulation for providing realistic and enhanced digital object viewing and interaction experience

ABSTRACT

Method, technology and system of user-controlled realistic 3D simulation and interaction are disclosed for providing realistic and enhanced digital object viewing and interaction experience with improved three dimensional (3D) visualization effects. A solution is provided to make available 3D-model/s carrying similar properties of real object, where performing user-controlled realistic interactions selected from extrusive interaction, intrusive interactions, time-bound changes based interaction and real environment mapping based interactions are made possible as per user choice.

FIELD OF INVENTION

The present invention relates to field of virtual reality, particularlyuser-controlled realistic 3D simulation and interaction technology forproviding realistic and enhanced digital object viewing and interactionexperience with improved three dimensional (3D) visualisation effects.The applications of user-controlled realistic 3D simulation andinteraction technology includes in the field of online shopping byproviding enhanced digital object viewing and interaction experience,collaboration and object demonstration, e-learning, media, entertainmentand content industry, computing, mechanical and communication industry.

BACKGROUND OF THE INVENTION

There is increasing trend in the use of three dimensional (3D) viewingin various industries such as in entertainment, mechanical engineeringdesigns view, online shopping sites, and offline product advertisementpanels. There are many web-based shopping markets, websites or storefronts which show images or in some case a short video of objects orproducts. The images are static and in some cases only enlarged orzoomed to get a clearer picture. In some other cases video of productsare captured, but this makes the loading, and ultimately viewing slow,and further user get to see whatever is captured mostly either bystreaming or through media player in two dimensional projections orpartly in three dimensions. The images and written information displayedprovides limited information about the desired object. Limitedinformation here means information that is written and displayed relatedto object, which is available for view to the end user. This is apassive way of information transfer. In conventional systems, web basedportals or sites, and online shopping portals, the user cannot interactwith the product as possible when user or customer physically visits ashop to a great extent, for example, viewing the product in all possibleangles, checking functionalities, asking any type of desired queriesabout the product, interacting with product to see its interior orexterior just like real scenario. This is active way of informationtransfer.

U.S. Pat. No. 7,680,694B2, U.S. Pat. No. 8,069,095B2, U.S. Pat. No.8,326,704 B2, US20130066751A1, US20120036040A1, US20100185514A1,US20070179867A1 and US20020002511A1, discusses about solution for 3Dview, and some form of interactions related of online shopping, shoppinglocation, and stores. This is limited to displaying the virtual shoppinglocation on a user computer by streaming a 3D interactive simulationview via a web browser. However, this doesn't provide for generating a3D model which has real object properties in true sense capable ofuser-controlled simulation and interactions not restricted or limited topre-set or pre-determined interactions. Conventional systems, methodsand techniques lack in generating 3D-model carrying properties of realobjects such as appearance, shape, dimensions, texture, fitting ofinternal parts, mirror effect, object surface properties of touch,smoothness, light properties and other nature, characteristics, andstate of real object, where performing user-controlled realisticinteractions such as viewing rotation in 360 degree in all planes,non-restrictive intrusive interactions, time-bound changes basedinteraction and real environment mapping based interactions as percharacteristics, state and nature of the said object are lacking. U.S.Pat. No. 7,680,694 B2, U.S. Pat. No. 8,326,704 B2, WO 01/11511 A1 alsodiscusses about a concierge or an animated figure or avatars or salesassistant, capable of offering information about products or graphics tocustomers, remembering customer buying behaviour, product choices,offering tips and promotions offer. These types of interactions arelimited to pre-defined set of offers, information about products. Theinput query is structured and generally matched with database to findand retrieve answers. However there still exists gap in bringing out thereal-time intelligent human-like interaction between the said animatedfigure and real human user. This is no mention of facial expressions,hand movements and precision which are prime criteria to receive aresponse from the animated figure or concierge which is human-like andas per the query of the real human user. For active communication, anatural interface such as understanding of language such as English isnecessary. Such technology to decipher meaning of language during textchat by a virtual assistant or intelligent system and provide user queryspecific response is costly endeavour and still a problem to be solved.

A JP patent with Application Number: 2000129043 (publication Number2001312633) discusses about a system, which simply show textureinformation, and touch sense information in form of write-up in additionto still picture information or a photographic image, an explanatorysentence, video, and only three-dimensional information which user haveto read. This and other U.S. Pat. No. 6,070,149A, WO0169364A3, WO02/48967 A1, U.S. Pat. No. 5,737,533A, U.S. Pat. No. 7,720,276 B1, U.S.Pat. No. 7,353,188 B2, U.S. Pat. No. 6,912,293 B1, US20090315916A1,US20050253840A1 discusses about 3D viewing and simulation, and virtualor online shopping experience. However lack in one or more of thefollowing points and technologies given below.

Further, most existing technology of 3D simulation for providing digitalobject viewing and interaction experience, in addition to above alsolack one or more of the following:

1. The existing simulated 3D-models are hollow models meaning suchmodels doesn't allows intrusive interactions such as to see explodedview of the parts of a simulated 3D-model of an object in real-time, oropen the parts of the 3D-model of object one by one as a person couldhave done in real scenario. For example, in conventional virtual realityset-up, a user cannot open the compressor of a refrigerator from avirtual 3D-model of refrigerator, or open or perform interactions withsub-part of the simulated 3D-model such as battery and other internalparts removed from a 3D-model of a mobile for interactions and realisticviewing, rotate tyres of car, move steering wheel to judge the movementand power steering, or examine the internal parts or interior built of asimulated 3D-model of mobile in real time. In some conventional cases,limited options are provided, on click of which an internal part of anobject is visible in photographic or panoramic view, but such cannot dofurther analysis of internal parts beyond the provided options. Anotherexample is 3D-view of a bottle filled with oil or any liquid, where onlya 3d-simulated view can be displayed in conventional systems, but a usercannot open the cork of the bottle, or pour the liquid from the bottlein an interactive manner as per his desire which is possible in realscenario. In other words user-controlled interaction is not feasible asper user choice.2. They don't allow realistic extrusive interaction such as rotating3D-model of object/s in 360 degree in different planes with ability ofinteraction from any projected angle. Mostly only 360 degree rotation inone plane is allowed in existing technologies. Further, current3D-simulation technology lacks to give a realistic 3D-simulation effector 3D visualization effect, lighting effect for light-emitting parts of3D-model of object, interacting with 3D-models having electronic displayparts for understanding electronic display functioning, sound effects,of object such that creating illusion of real objects is not veryprecise in virtual views. In real object input is given at some partsuch as sound button on TV of real object to perform desired operationsuch as producing sound in speakers. Similarly input in 3 d object canbe provided to perform operation of the part of 3d object emulating realscenario.3. Another lack of originality and closeness to real-set up is operatingpressure, judging sense of taste, sense of touch. For example, a useropening a movable-part of multi-part object such as refrigerator, wherethe user holds the handle, and applies pressure to open the refrigeratordoor. Existing virtual 3D-simulated models of object and technologycannot judge the smoothness or softness of the handle and the operatingpressure or force required to open the refrigerator door.4. Monitoring or visualizing time-bound changes observed on using oroperating an object is not possible. User cannot check product or objectbehavior after a desired duration. For example checking the heating ofiron, or cooling in refrigerators, or cooling generated by airconditioners in a room. Further, user cannot hear the sound when arefrigerator door is opened from a simulated 3D-model of object whichmimics the real sound produced when opening the door of a realrefrigerator in real setup. Further change in sound after certainintervals of time cannot be heard or monitored to experience the productperformance, or to compare it with other product.5. Further in real scenario a user can switch on a laptop, computer,iPad, mobile or any computing device, and check the start-up time, speedof loading of the operating system, and play music etc. Suchinteractions are lacking in real time for various virtual 3D-models andchoice of user is limited to observing only the outer looks of theobject such as laptop.6. Real environment mapping based interactions are interactions whereuser environment, that is the place or location in the vicinity of user,is captured through a camera, mapped and simulated in real-time suchthat a realistic 3D-model or virtual object displayed on electronicscreen can be seen interacting with the mapped and simulatedenvironment. Such real-time interactions including mirror effect arelacking in current technologies.7. The existing technology doesn't allow dynamic customization oftexturing pattern of 3D-model during loading of the 3D-model.

Such real-time and enhanced interactions are lacking in current virtualreality related technologies. The above constraints in current availabletechnology/technologies makes very difficult for human user to interactwith things virtually in a way that he/she can interact in real world,and hence there is need for a technology that enhances digital objectviewing and interaction experience, and bridges the gap between real andvirtual world in true sense.

SUMMARY OF THE INVENTION

It is an object of the invention to provide a system of user-controlledrealistic 3D simulation for enhanced object viewing and interactionexperience capable of displaying real products virtually in interactiveand realistic 3D-model. The user-controlled realistic 3D simulation andinteraction technology of the said system comprising a 3D-modeldisplayer with virtual operating sub-system is useful to see digitalobjects in a three dimensional view from all angles like in real world,and simultaneously also operate simulated 3D-model of the object inrealistic manner producing a realistic 3D visualisation effect over anelectronic display.

Another object of the invention is to provide a method ofuser-controlled realistic 3D simulation for providing realistic andenhanced digital object viewing and interaction experience using thesaid system of user-controlled realistic 3D simulation. A solution isprovided to make available a 3D-model carrying similar properties suchas appearance, shape, dimensions, texture, fitting of internal parts,object surface properties of touch, smoothness, and other nature,characteristics, and state of real object, where performinguser-controlled realistic interactions selected from extrusiveinteraction, intrusive interactions, time-bound changes basedinteraction and real environment mapping based interactions are madepossible as per user choice in real-time and as per characteristics,state and nature of the said object. The user-controlled realistic 3Dsimulation and interaction technology can allow dynamic customization oftexturing pattern of 3D-model during loading of the 3D-model, therebyproviding selective loading ability to 3D-model and making efficient useof memory. This optimizes the loading time, such that there is no orminimum visible impact on the viewing of 3D-model of the object even ifdata is transmitted over web-page via hypertext transfer protocol(HTTP). Another further object of the invention is to make possiblebuilding dynamic interactive points in real-time capable of displayingvirtual 3D-objects in a live video from a live telecast of a placehaving plurality of real objects.

Another further object of the invention is to provide a virtualoperating sub-system for providing functionality of operation ofdisplayed 3D-model, where the virtual operating sub-system is installedduring loading of said 3D-model as per characteristics, state and natureof displayed object.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a flowchart illustrating the method of user-controlledrealistic simulation and interaction for enhanced object viewing andinteraction experience according to invention;

FIG. 2 and FIG. 3 show different schematic and perspective views of3D-model of mobile depicting extrusive and intrusive interactionsaccording to an preferred embodiment of invention;

FIG. 4 shows different perspective views of 3D-model of a multi-partobject such as refrigerator depicting extrusive interaction in 360degree in more than one plane according to an preferred embodiment ofinvention;

FIG. 5 shows perspective views of 3D-model of refrigerator depictinganother example of intrusive interaction according to a preferredembodiment of invention;

FIG. 6 shows different schematic views of 3D-model of a laptop showingintrusive interaction using a virtual operating sub-system according toinvention;

FIG. 7 shows schematically a temperature view of simulated 3D-model ofiron, depicting heating of iron lower surface at different timeintervals as per time-bound changes based interactions according to anembodiment of invention;

FIG. 8 shows different perspective views of a realistic 3D-simulation ofa chair with its touch view for judging softness of seat and backcushion in an intrusive interaction according to invention;

FIG. 9 shows in a schematic view virtual simulation of 3D-model of aliquor bottle in a taste view according to according to an embodiment ofinvention;

FIG. 10 shows schematic view of different frames of an continuoususer-controlled 3D simulation and interaction with a 3D-model of atoothpaste tube showing paste coming out of the tube in intrusiveinteraction according to invention;

FIG. 11 shows perspective views of 3D-model of a bike depicting anexample of intrusive interactions of seat change and extrusiveinteraction of lighting effect as per user choice according toinvention;

FIG. 12 shows perspective and partial enlarged views of 3D-model of thebike of FIG. 11 depicting operating pressure view as an example ofintrusive interactions according to invention;

FIG. 13 shows further intrusive interactions for the 3D-model of thebike of FIG. 11, where some parts of the 3D-model have beendisintegrated as per user choice according to invention;

FIG. 14 shows perspective views of 3D-model of a car showing anotherform of intrusive interactions according to a preferred embodiment ofthe invention;

FIG. 15 shows schematic perspective views of environment mapping basedinteractions according to a preferred embodiment of invention.

FIG. 16 shows mirror effect as another form of environment mapping basedinteractions according to a preferred embodiment of invention.

FIG. 17 shows different schematic and perspective views of interactivevideo of 3D-graphics environment model of interior of a refrigeratorshowroom in a consolidated view category according to an embodiment ofinvention;

FIG. 18 shows a perspective representation of a panoramic view of a3D-graphics environment model of interior of a refrigerator showroomcontaining 3D-models of different refrigerators in a consolidated viewcategory according to a preferred embodiment of invention;

FIG. 19 shows a perspective representation of a panoramic view of a3D-graphics environment model of interior of a refrigerator showroomcontaining 3D-models of different refrigerators in a consolidated viewcategory with a virtual assistant sub-system according to a preferredembodiment of invention;

FIG. 20 shows schematic and perspective representation of a livetelecast of a remote physical shop, where change in object is recognisedand dynamic links are built in real-time for display of 3D-models ofaccording to an embodiment of invention;

FIG. 21 shows perspective views of a mechanical engineering design of a3D-model of a lathe machine for remote demonstration according to anembodiment of invention;

FIG. 22 shows another flowchart illustrating the method ofuser-controlled realistic simulation and interaction for enhanced objectviewing and interaction experience according to invention;

FIG. 23 shows a system of user-controlled realistic simulation andinteraction for enhanced object viewing and interaction experienceaccording to invention;

DETAILED DESCRIPTION

FIG. 1 shows a flowchart illustrating the method of user-controlledrealistic simulation and interaction for enhanced object viewing andinteraction experience. Step 1101, involves receiving request by any oneinput mode for display of an object. In step 1102, an image of the saidobject or object containing consolidated-view category is displayed. Instep 1103, a second request is received by any one input mode fordisplay of 3D-model of the said object, which is followed by loading andsimulating of 3D-model of the said object in real-time (step 1104). Avirtual operating sub-system may be installed in the loaded 3D-modelbased on characteristics, state and nature of the said object. Forexample, If the requested object is a computer or laptop, smart phone orany computing device, a virtual operating system is also loaded andinstalled within the loaded 3D-model such as within simulated 3D-modelof laptop based on product or brand characteristics such as if anwindows version operating system was present in the real productspecification, a virtual operating system pertaining to the said windowsversion style operating system will load accordingly in real time and asper state and nature of the desired object. The characteristics, stateand nature of displayed object means the loaded object are displayed andthe interactions available are as per their real characteristics andnature in reality. The characteristics, state and nature of the objectincludes the real object properties such as single part object,multi-part object, digital or communication devices such as laptop,smart phones, and computers, solid, liquid, semi-solid, gaseous objectstate properties, or operation status such as object in opened state orclosed state etc. By nature of the object, it means expected behaviourand the purpose of the object. One cannot expect in real setup todisintegrate a single part object or judge the taste view of car. Forexample if the desired object is a iron, testing its heating property isjustified, and not the coldness as for this object expected behaviourand the purpose of the object is producing heat for pressing clothes.The step of generation of 3D-model of the said object involves: a) usingimage associated data of said object, and auto-linking with real objectassociated data such as characteristics, state and nature of saidobject, polygon data and texturing data of the said object in asimulative manner; and b) transforming the linked polygon data,texturing data, image associated data and real object associated datainto 3D-model of the said object. In step 1105, displaying 3D-model ofthe said object in 3D-computer graphic environment is carried out, wherethe displayed 3D-model of the said object comprises at least onerealistic 3D-view. The realistic 3D-view is first realistic 3D-view, apressure view for judgment of pressure required to operate the saiddisplayed object, a taste view to judge perception of sense of taste, atemperature view for judging heat generated during operation of the saiddisplayed object after certain time intervals, a touch view for judgingthe sense of softness touch when applied on the displayed object. Thefirst realistic 3D-view is displayed by default. The pressure view, thetaste view, the temperature view, the touch view are available, anddisplayed on request, as per characteristics, state and nature ofdisplayed object. The pressure view is for solid objects which can beoperated, e.g. a refrigerator, gasoline generator or hand pump. Thetaste view is available for food items, emulating real life scenario.The taste views helps in judging the taste of object and compare thetaste with other objects showing the extent of bitterness, sweetness,sourness, saltiness, emami taste or as per food in question. Thetemperature view helps to see the temperature change for objects in realset-up dealing with temperature e.g. refrigerators, air conditioners,iron, any electronic devices as they generate heat after prolongedoperation in real set-up. The touch view helps in ascertaining softnessand smoothness through colour representations making available anotherparameter of judgment available for comparison. The properties ofheating, cooling, softness, hardness and pressure applied to open oroperate a movable sub-part of multi-part 3D-model is represented bytexturing the 3D-model in different colour, where different pressure,temperature, softness or hardness is distinguished at differentsub-parts of said 3D-model or entire 3D-model in different colours. Instep 1106, user-controlled realistic interactions with the displayed3D-model are made available to user. The user-controlled realisticinteractions include extrusive interaction and/or intrusive interactionsand/or time bound changes based interaction and/or real environmentmapping based interactions as per user choice and as percharacteristics, state and nature of the said object. The extrusiveinteraction is interaction possible from exterior of any real objects.The extrusive interaction with 3D-model emulates real life scenario withregards to viewing or examining the object. On receiving input forviewing the object in different angles, as per user choice, the 3D-modelof object/s is rotated in 360 degree in different planes. The saidobject is displayed as per received input. In extrusive interactions,simulating parts of 3D-model of a multipart object/s is made possible asper user choice. The simulation is displayed such that viewing,examining and testing object functionalities or product features is madepossible in real-time with precision, where polygons along withassociated texture of said 3D-model moves as per user command, andmovement of 3D-model or its parts is achieved and displayed in real timeand with precision based on user input commands. The intrusiveinteraction includes viewing and examining internal parts,disintegrating parts of the object in real-time one by one to examineinterior and individual parts of the said object. The polygons alongwith associated texture of said 3D-model moves as per user command, andmovement of 3D-model or its parts is achieved and displayed in real timeand with precision based on user input commands. The movement of3D-model or its parts is achieved and displayed in real time, and withprecision based on user input commands as per characteristics, state andnature of displayed object. The time bound changes based interactionscomprises monitoring or visualizing time-bound changes observed on usingor operating an object. User can check product or object behaviour aftera desired duration. For example checking the heating of iron, or coolingin refrigerators, or cooling generated by air conditioners in a room ispossible. Further, user can hear the sound when a refrigerator door isopened from a virtual simulation of 3D-model of object which mimics thereal sound produced when opening the door of a real refrigerator in realsetup. Further change in sound after certain intervals of time can beheard or monitored to experience the product performance, or to compareit with other product. The pressure view, the taste view, thetemperature view and the touch view interactions are also included inthe time bound interactions. The real environment mapping basedinteractions comprises of interactions where user environment, that isthe place or location in the vicinity of user, is captured through acamera, mapped and simulated in real-time such that a realistic 3D-modelor virtual object displayed on electronic screen of user can be seeninteracting with the mapped and simulated environment. In step 1107,user performs user-controlled realistic interactions with the displayed3D-model by providing at least one input, where performed interactionsare displayed in at least one realistic 3D-view.

FIG. 2 and FIG. 3 show 3D-models of mobile in various extrusive andintrusive interactions. FIG. 2 a-2 d shows rotation of 3D-model ofmobile in more than one plane as per user choice and in real-time. The3d-model of mobile can be rotated by user in any angles in its 360degree course to return to its original position. Users desiring tocheck battery size and internal components can perform intrusiveinteractions such as opening a back cover (201), further taking outmobile battery (202,202) in real-time to see dual SIM layout in the said3d-model. Further, if user desires to further check and inquire aboutother internal components (203) of mobile, the user can open the mobileand check 3d-model of the sub-part as shown in FIG. 2 h, or ask avirtual assistant sub-system to gain active product information. FIG. 3shows user interacting with the 3D-model of mobile, where the user notonly views the mobile but also is able to interact intrusively bysliding the mobile to check numeric keypad (302), pressing number keys,where the numbers pressed (303) is reflected real time in mobile screen(302) of 3D-model of the said mobile. The user can check all functionsin virtual 3D-space of a 3D-model displayer (2305 of FIG. 23). The saiduser can interact with the 3D-model of mobile simulated just like realsetup, such as to open message, see contact list, press buttons, usecamera virtually very similar to what we do with real mobile. In FIG. 3d, on pressing contact (304), contact page (304′) is displayed ininteractive manner using a virtual operating sub-system (2308 of FIG.23) of a system. Similarly, by providing an input (305) desiring tointeract to view operation of touch numeric keypad, an on-screen numerickeypad (305′) is displayed in the said 3D-model mimicking thefunctionalities of real mobile, which would have been operated inphysical set-up. The interactions displayed are not the onlyinteractions possible. The user can do numerous interactions as per hisdesire and the interactions possible holding a mobile in hand. The usercan further see the exploded view of the mobile parts, or disintegrateparts one by one such as taking out SIM slot, opening front cover,judging smoothness of mobile body, or switching on to judge the starttime, processing speed, operate the mobile to check functionalities etcmimicking real-setup. Other extrusive interactions can be lightingeffect for light-emitting parts of 3D-model of object, interacting with3D-models having electronic display parts for understanding electronicdisplay functioning and sound effects emulating real scenario.

FIG. 4 shows different perspective views of 3D-model of a refrigerator,where extrusive interaction of rotation is performed. In FIG. 4,realistic rotations in various angles are shown to be carried out withhelp of a pointing device such as mouse cursor movement. All rotationsin 360 degree in all planes are possible using any conventional inputdevices such as keyboard, pointing device. The virtual assistantsub-system can also be used as input mode for requesting in the form ofvoice command or chat in natural language such as English. Further, inFIG. 5 a-5 e, perspective views of the same 3D-model of the refrigeratoris shown as another example of intrusive interaction, where when theuser provides input like click on movable-part such as doors (501,502)for opening closed doors of simulated 3D-model, the user gets a view ofopening of doors (501′,502′) in a continuous movement simulation such asin animation (5 b) emulating real scenario. Further, if user desires tofurther investigate lower portion of refrigerator, the user can openlower drawer (503) of the 3D-model by clicking on its lower movablepart, the drawer in a continuous movement, where this operation can beperformed on already first 3D-model simulation (5 b) of opened door thatwas performed earlier. A real-time 3D-simulation of the opened drawer(503′) is generated and presented before the user as seen in 5 c of FIG.5. The user can upload his own photograph to generate a virtualsimulation of himself (504,504′) representing self. The simulated human3D-model can walk as per his desire to a showroom or directly visit aproduct. The simulated human 3D-model can not only walk and experience adifferent virtual world but can see himself operating the product. Here,the human 3D-model is shown walking to the 3D-model of refrigerator, toopen door (501″) of displayed 3D-model of refrigerator himself (5 e).The lights in the refrigerator will also turn-on on opening the door,and cooling can also be experienced virtually mimicking the real lifeset-up. The interactions displayed are not the only interactionspossible. For example, user instead of uploading his own photograph forsimulating virtual 3D-model of himself, can also select virtual avatars,where the avatar/s selected can do interactions such as walking towardsthe product or a product showroom experiencing a different virtualworld, and also operating the product. Even pressure applied to open thedoor by the user can be judged using another operating pressure view.This view calculates the pressure and displays using available standardmetrics to calculate energy or pressure. This can be compared with otherobjects so as to get better informed to decide choosing of a productemulating a real scenario in real set-up. The sound of the refrigeratordoor opening, if any as per the real product can be heard throughconventional sound devices such as a speaker connected with the system,where display of 3D simulation is carried out.

FIG. 6 shows different schematic views of 3D-model of a laptop showingintrusive interaction with a virtual operating sub-system (OS). FIG. 6 ashows virtual simulation of 3D-model of a laptop schematically inpower-off mode. A user can not only check the laptop looks and comparespecification, but can operate the laptop just in real life scenariosuch as switching it to judge start-up time, which is the real start-uptime for the said product, if the product would have been started inreal life set-up. The virtual operating sub-system (OS) is shown loadedwithin the 3D-model of the laptop. FIG. 6 b shows schematicallyrealistic simulation of a laptop, starting (601) with the help of thevirtual operating sub-system (OS). The virtual operating sub-system isbuilt with artificial intelligence and realistic 3D-simulation andinteraction technology. The virtual operating sub-system (OS) mimics thereal operating systems loaded in the existing systems or computers orany computing devices for operation such that hardware of the displayedvirtual simulation of 3D-model of a laptop can be operated through thevirtual operating sub-system. FIG. 6 c shows started virtual operatingsub-system ready for user login such that system booting time can beestimated virtually such as in real scenario.

FIG. 7 shows schematically a temperature view of simulated 3D-model ofiron (7 a-7 b), depicting heating of iron lower surface at differenttime intervals (7 c-7 e) as per time-bound changes based interactions.The simulation of 3D-model of iron here is shown schematically. Atemperature adjusting knob (701), when set to a particular temperaturemode such as cotton, which is a high temperature mode (702), the heatinginteractions begins emulating real scenario. The heating generated inthe iron is ascertained by colour coding from light to dark shadesrepresenting low to high temperature respectively and can be displayedin standard metrics such as degree, Celsius or Fahrenheit in aparticular time interval (not shown in figure). After 1.5 minutes ofoperation, say the iron heats to 70 degree Celsius of temperature. Thevalue comes when two 3D-models of different products are compared (7 fand 7 g) for temperature at same time say one minute after operation,and see the difference in generated temperature in real-time withoutactually having to operate the iron, which might not be possible orallowed in real set-up.

FIG. 8 shows different perspective views of a realistic 3D-simulation ofa chair with its touch view for judging softness and hardness of seatand back cushion in an intrusive interaction. The chair in FIGS. 8 a and8 c transforms to another view, represented in shades of colours intouch view to depict softness of seat, and cushion (8 b,8 d). Thesoftness can be colour coded from light to dark shades or in colourcoded in different distinguishing colours representing very soft, softto hard surfaces respectively, or an index is displayed in numericalstandard allowing comparison of products with the parameter of softnessor smoothness.

FIG. 9 shows schematic view of virtual simulation of 3D-model of aliquor bottle (9 a) in a taste view. When a user selects a taste viewfor food items such as liquor in this embodiment, taste types isdisplayed mimicking the brand taste for which object is displayed. Thisfeature of invention goes beyond the real-setup scenario, as in realscenario, users before buying a product cannot open the bottle or tastethe product. The user can also open cork of the bottle, or pour theliquid (9 b-9 c) from the simulated of 3D-model bottle emulating realscenario.

FIG. 10 shows schematic view of different frames of a continuousanimation of virtual simulation of 3D-model of a toothpaste tube showingpaste coming out of the tube in an intrusive interaction. The cap ofvirtual simulation of 3D-model of toothpaste tube is opened, and thetube is pressed to squeeze out paste (14 a-14 c). The paste color canalso be observed together with the exterior body of the paste tube. Thestrength required to press the tube can also be judged and compared withanother paste of different product or brand, where the characteristics,state and nature of product is same as of the real product in realstore.

FIG. 11 shows perspective views of 3D-model of a bike depicting anexample of intrusive interactions of seat change and extrusiveinteraction of lighting effect as per user choice, where a part of a3D-model can be opened, exchanged or changed for another part of similarnature in different colour or shape as per user choice. Here, seat(1101) of the 3D-model of a bike is a sub-part of multi-part objectbike, which is changed to different coloured seat (1102) to match withthe body of the bike as per user choice performing an intrusiveinteraction virtually. The 3D-model of a bike can also been seen inpressure view to judge operating pressure of its parts. FIG. 12 showsperspective and partial enlarged views of 3D-model of the bike of FIG.11 depicting pressure view (12 a), where pressure or force required tooperate a brake (12 b) or operate a kick (12 c) can be judged either bycolor shade differentiation in an intrusive interaction. A pressure (p1)generated while operating the kick is shown in FIG. 12 c. The user canfurther check individual parts of the 3D-model of the bike as shown inFIG. 13, where some parts such as wheel (1301,1301′,1301″), of the3D-model have been disintegrated as per user choice. The pressurerequired to open or operate a movable sub-part such as brake clutch(1203), kick, switch (1202), choke (1201) etc. of multi-part 3D-modelsuch as bike in this case is represented by texturing the 3D-model indifferent colour. A lighting effect (1103,1104) is produced forlight-emitting parts of simulated 3D-model emulating real objectproperties of light. A light-emitting part such as head-light (1103) isoff-mode (1103), where the user desiring to check lighting of head-lightcan provide input to perform interaction of switching on (1104) thehead-light, which is displayed on the simulated 3d-model of bike. Otherextrusive interactions includes interactions with 3D-models havingelectronic display parts for understanding electronic displayfunctioning, where sound effects are produced in realistic way like inreal scenario of user performing interactions. The interactions aredisplayed as per input, with precision, where polygons along withassociated texture of said 3D-model moves as per user command, andmovement of simulated 3D-model or its parts is achieved and displayedwith precision based on user input commands.

FIG. 14 shows perspective views of 3D-model of a car (14 a-14 c) showinganother form of intrusive interactions. Doors (1401′) of a simulated3D-model of a car (14 a) can be opened in a manner such as in realscenario in true sense. An exploded view of 3D-model of a car can beviewed to introspect each part as per user choice in user-controlledrealistic simulation. Further, the steering wheel can be rotated tojudge power-steering, smoothness of tyres can be judged, whereindividual parts are disintegrated in real-time using theuser-controlled realistic simulation and interaction technologymimicking the real life scenario. The disintegrated parts, e.g. wheel inthis case, are also displayed in 3D-simulation view, where individualparts such as wheel can be rotated separately just like real set-up.

In FIG. 15, an example of environment mapping based interactions isshown schematically, where in FIG. 15 a, a section of a room (1501) withreal sofa (1503), and a system with a camera (1502) is shown. The camera(1502′) mounted on an electronic screen (1507) captures the video of theroom section with the sofa. The captured video (1504) is shown in frontside of an electronic screen (1507′) in FIG. 15 b, where simulated3D-model of sofa cushion (1505) is also displayed by a 3D-modeldisplayer (1506,1506′) for interaction. The user can initiateenvironment mapping simulation by requesting the virtual assistantsub-system. The virtual assistant sub-system directs camera to capturethe video of the section of the room (1501) with real sofa (1503). Thedesired object that is cushion (1505′) is placed over the captured videoof sofa (1503″) as seen in FIG. 15 c interactively in through the3D-model displayer (1506′) to check the compatibility in terms of colourmatch and aesthetics to make an informed decision to select the cushionor search for different product/cushion as per user choice.

FIG. 16 shows mirror effect as another form of environmental mappingbased interactions, where in FIGS. 16 a and 16 b, front top portion of3D-model of bike (1605,1605′) is shown zoomed with a rear view mirror(1603,1603′), a front webcam (1601,1601′), an electronic screen(1602,1602′), and a user (1604) sitting in front of the displayed3D-model of bike. A reflection (1604′) of face of user can be seen onthe rear view mirror (1603′) of the 3D-model of the bike just like inreal scenario. The reflection (1603′) is generated in real-time when auser sitting in front of the electronic screen initiates environmentmapping simulation through any input mode using a system ofuser-controlled realistic simulation and interaction. Another example issimulated 3d-model of dressing table producing reflection of user bodyin the said mirror effect. During interacting in panoramic view, thevirtual assistant (1901,1901′) remains intact in same position over thepanoramic view while panoramic image or panoramic model moves ininteractive and synchronized manner

FIG. 17 shows different schematic and perspective views of interactivevideo of 3D-graphics environment model of interior of a refrigeratorshowroom in a consolidated view category. The virtual assistant is askedto display refrigerator showroom, which is loaded on the right hand side(17 a). In drawing 17 a, a virtual assistant (1701) is displayed on theleft hand side capable of initializing real-time intelligent human-likechatting interaction with real user. 3D-models of different refrigerator(1703,1704,1705) are displayed in an interactive video of interior of 3Dcomputer graphic model of a refrigerator showroom. A mouse cursor (1702)is shown in 17 b, on the click of which on the path, and dragging back,other 3D-models of a refrigerator (1706,1706′) are displayed as seen inFIGS. 17 c and 17 d. FIG. 17 d shows that user wants to furtherintrospect the first refrigerator (1703), and hence can request for thedisplay of realistic 3D-model of the selected refrigerator for furtheruser-controlled realistic interactions as shown in FIG. 4 and FIG. 5.

FIG. 18 shows perspective representation of a panoramic view of arefrigerator showroom showing different refrigerators in a consolidatedview category. The panoramic view category is a 360 degree view ofvirtual place such as a showroom. The panoramic view is shown indifferent frames (18 a-18 c), where the change in continuous motion. Theobjects such as refrigerator shown in the panoramic showroom areinteractive objects, on click of which a 3D-model of refrigerator isloaded, where the 3D-model is capable for generating user-controlledrealistic simulation and interactions. The facial expressions, handmovements, mouth movement etc. of the said virtual assistant works insynchronised manner just like real scenario while a real human speaks.The response to user query is and human-like and as per the query of thereal human user.

In FIG. 19 another perspective representation of a panoramic view of a3D-graphics environment model of interior of a showroom is showncontaining 3D-models of different objects with virtual assistant(1901,1901′). The virtual assistant can also be an image or 3D-model,where the virtual assistant (1901′) is shown moving lips in response toa query. When the user moves the panoramic view with area position (A-1)to area position (A-2), the virtual assistant is still intact at itsprevious position giving improved panoramic image or model viewingexperience, which is made possible by synchronised movement usinguser-controlled realistic simulation and interaction technology.

FIG. 20 shows schematic and perspective representation of a livetelecast of a remote physical shop, where change in object is recognisedand dynamic links are built in real-time for display of 3D-models. Inthe live video, it becomes difficult to detect type of objectautomatically in real time, and recognise change in object if the objectis replaced in real store, such as a refrigerator (2010) to a washingmachine (2020). The system of user-controlled realistic interaction ofinvention can recognise the change in object in real-time or with sometime lag, and build dynamic links over each object identified. The useron providing input such as clicking on the objects displayed on thevideo can initiate display of 3D-model of the said object for furtheruser-controlled interactions. The video of the physical showroom can becaptured by conventional devices such as via a camera capable ofcapturing video, a transmitting unit and a receiving unit. The cameracan be video camera or panoramic video camera. The receiving unit canreceive the said video, and supply live feed to a central database ofthe system of user-controlled realistic interaction. The live feed datacan be processed to make it compatible to run and viewed over http evenin a website. The video of the physical showroom can be displayed eitherreal-time or with some time lag.

FIG. 21 shows perspective view of a mechanical engineering design of a3D-model of a lathe machine for remote demonstration as anotherapplication of the user-controlled realistic simulation and interactiontechnology. It becomes difficult to collaborate and demonstrate complexmachineries remotely using conventional means. The 3D-models simulatedby user-controlled realistic simulation and interaction technology arenot hollow and complete emulating real objects in real scenario, whichcan be used to provide remote demonstration of working of the saidmachine using extrusive, intrusive and time bound changes basedinteractions such as heating produced after certain time intervals. Asliding motion of middle part of lathe machine from one position (2101)to another position (2102) takes place on rotating a wheel (2103,2104)from one position (2103) to another position (2104) emulating real-set.The user can interact with its parts, to understand its functioning invirtual but real like setup, as the user would have interacted with realmachine. If the user wishes to know more about the said product ormachine, he can simply query the virtual assistant, which replies withprecise answers as per the query. Query can be typed in a chat, wherethe virtual assistant will reply either by speaking or by action ofmoving lips or written message to solve the query.

FIG. 22 shows another flowchart of a method of user-controlled realisticsimulation and interaction for enhanced object viewing and interactionexperience. Step 2201, involves decision making in choosing of modesselected from either a showroom mode or product mode. The step 2201 isfollowed by different layouts displayed as per chosen mode. A showroomview layout (2202) is displayed, if showroom mode is chosen, or aproduct view layout (2203) is displayed, if product mode is chosen. Instep 2204, input is provided by user for display of showroom type inpre-set consolidated view category after display of showroom viewlayout, where an input is requested for display of showroom type such asTV showroom, refrigerator showroom as per user choice. In step 2205,selective loading of showroom type in pre-set consolidated view categorytakes place. The user may have the option to switch views in oneembodiment, if there is slow connection. If the network is slow, theentire showroom view is not loaded, whereas if the network and processorspeed is satisfactory, then entire showroom view is loaded, butsimulated and texturing is adjusted such that there is minimum visualimpact on user side. This helps to minimize impact of slowness ofnetwork speed and processing power on the experience of viewing therealistic virtual simulations. This also enables quick loading ofgraphics for seamless viewing. In step 2206, among the plurality ofobjects displayed, an input is received for display of realistic 3Dmodel of desired object, where this step can be directly reached orinitiated after display of product view layout (2203) under productmode. The receiving input can be through conventional devices such as apointing device such as mouse, via a keyboard or hand gesture guidedinput or eye movement guided input captured by a sensor of a system ortouch, or by providing command to a virtual assistant system. Thecommand to the virtual assistant system can be a voice command or viachat. In step 2207, realistic 3D-model of the desired object is loadedand simulated for which input is received. If the desired object is acomputer or laptop or any computing device, a virtual operatingsub-system is also loaded and installed within the loaded 3D-model suchas within simulated 3D-model of laptop based on product or brandcharacteristics. Step 2208 involves displaying 3D-model of the desiredobject in 3D-computer graphic environment. The displayed 3D-model of thedesired object has standard realistic 3D-view by default. Otherinteractive views can be a pressure view for judgement of pressurerequired to operate the said displayed object, a taste view to judge theperception of sense of taste, a temperature view for judging heatgenerated during operation of the said displayed object after certaintime intervals and a touch view for judging the sense of softness touchwhen applied on the displayed object. Other views are available as percharacteristics, state and nature of displayed object. In step 2209,user-controlled realistic interactions can be performed and madeavailable with the displayed realistic 3D-model for emulating realscenario in real set-up. The user-controlled realistic interactionscomprises of extrusive interaction, intrusive interactions, time boundchanges based interaction, real environment mapping based interactionsand/or user body mapping based interaction as per user choice and as percharacteristics, state and nature of displayed object.

FIG. 23 shows a system of user-controlled realistic simulation andinteraction for enhanced object viewing and interaction experience. Thesaid system comprises:

-   -   a) a graphical user interface (GUI) connected to a central        search component configured for accepting user inputs;    -   b) a consolidated view displayer for displaying 3D graphics        environment, containing one or more 3D-models in an organized        manner using a 3D consolidated view generating engine;    -   c) a 3D-model displayer for displaying 3D-model of an object        simulated using a 3D objects generating engine, where the        3D-model displayer comprises at least one display space for        displaying the virtual interactive 3D-model;    -   d) a virtual operating sub-system for providing functionality of        operation of displayed 3D-model, where the virtual operating        sub-system is installed during loading of said 3D-model as per        characteristics, state and nature of displayed object, where the        virtual operating sub-system is in direct connection to the        3D-model displayer and the 3D objects generating engine;    -   e) optionally a virtual assistant sub-system as one input mode        for two way communication;    -   f) optionally a live telecast displayer for displaying live        telecast of a place containing plurality of objects, where a        dynamic link is built over each identified object, where each        dynamic link invokes the 3D-model displayer for displaying        3D-model of the said identified object; and    -   g) optionally a camera for capturing video for background        mapping based interaction, where the video captured from the        camera is layered beneath the 3D-model displayer;

The GUI (2302) is in direct connection with the consolidated viewdisplayer (2303), the virtual assistant sub-system (2304), the 3D-modeldisplayer (2305), and the central database (2309) in addition to thecentral search component (2301), and where the 3D-model displayer (2305)and the 3D-model generating engine (2307) are in direct connection toeach other, and are also connected to the virtual operating sub-system.The 3D-model displayer makes possible displaying real world objectsvirtually by user-controlled realistic simulation of 3D-model of thesaid objects in a manner such that interaction is made possible with thesaid objects in a life-like manner in real scenario. The 3D-modeldisplayer is an interactive platform for carrying out extrusiveinteraction and/or intrusive interactions and/or time bound changesbased interaction and/or real environment mapping based interactions asper user choice and as per characteristics, state and nature of the saidobject. The 3D objects generating engine uses image associated data,real object associated data, polygon data and texturing data of the saidobject for generating said 3D-model, where the simulated 3D-modelcomprises plurality of polygons. The said system can be implemented overhyper text transfer protocol in a wearable or non-wearable display. Thevirtual assistant sub-system comprises a graphical user interface, anatural language processing component for processing of user input inform of words or sentences and providing output as per the receivedinput, where the natural language processing component is integrated tothe central database. The virtual assistant sub-system further includesa microphone for receiving voice command, and sound output device.

It will be noted that the drawing figures included are schematicrepresentations, and generally not drawn to scale. It will be furthernoted that the schematic representations are used for explaining presentinvention, and are not actual 3D-models as per present invention. Itwill be understood that virtually any computer architecture such asclient-server architecture may be used without departing from the scopeof this disclosure. The system (FIG. 23) may take form of a servercomputer, where some components like camera, GUI, 3D-models are used ordisplayed or accessed at client side by LAN or through INTERNET. In someembodiments, the client side can also be a hand-held computing devicesuch as laptop, smart phone etc.

Although a variety of examples and other information have been used toexplain various aspects within the scope of the appended claims, nolimitations of the claims should be implied based on particular featuresor arrangement in such examples, as one ordinary skill would be able touse these examples to derive a wide variety of implementations. Thepresent embodiments are, therefore, to be considered as merelyillustrative and not restrictive, and the described features and stepsare disclosed as examples of components of systems and methods that aredeemed to be within the scope of the following claims.

We claim:
 1. A method of user-controlled realistic 3D simulation forenhanced object viewing and interaction experience, the methodcomprising: receiving request by at least one input mode for display ofan object (1101); displaying image of the said object or objectcontaining consolidated-view category (1102); receiving second requestby at least one input mode for display of 3D-model of the said object(1103); loading and simulating 3D-model of the said object in real-time,wherein a virtual operating sub-system is optionally installed in theloaded 3D-model based on characteristics, state and nature of the saidobject, and where loading and simulating 3D-model of the said objectcomprises: i. using image associated data of said object, andauto-linking with real object associated data, polygon data andtexturing data of the said object in a simulative manner; ii.transforming the linked polygon data, texturing data, image associateddata and real object associated data into 3D-model of the said object(1104); displaying 3D-model of the said object in 3D-computer graphicenvironment, where the displayed 3D-model of the said object comprisesat least one realistic 3D-view (1105); making available user-controlledrealistic interactions with the displayed 3D-model to an user, where theuser-controlled realistic interactions include extrusive interaction(FIG. 4) and/or intrusive interactions (1 e-1 h,3 b-3 f,5 b-5 e,6 a-6c,9 a-9 c,10 a-10 c,FIG. 11,FIG. 13,FIG. 14) and/or time bound changesbased interaction (FIG. 7), and/or real environment mapping basedinteractions (FIG. 15,FIG. 16) as per user choice and as percharacteristics, state and nature of the said object (1106); performinguser-controlled realistic interactions with the displayed 3D-model andsimultaneous displaying in at least one realistic 3D-view with at leastone input (1107).
 2. The method as in claim 1, wherein loading of 3Dmodel of the said object is routed either directly, or through aconsolidated-view category (FIG. 17,FIG. 18,FIG. 19) or via livetelecast category (FIG. 20) as per user choice or in pre-determinedmanner, where the consolidated-view category emulates real showroom viewcontaining real products, and is selected from an interactive video viewcategory or an interactive panoramic view category, where duringinteracting in panoramic view, a virtual assistant (1901,1901′) remainsintact in same position over the panoramic view while panoramic image orpanoramic model moves in interactive and synchronized manner, and wherethe virtual assistant while remaining intact is capable of moving mouth,carrying out hand movements and portraying facial expressions whilereplying to user query in interactive manner, and where during loadingof the 3D-model, texturing pattern and/or polygons of 3D-model is eitherdynamically customized or entire 3D-model is loaded without texturingpattern customization.
 3. The method as in claim 1, wherein realistic3D-view is first realistic 3D-view, a pressure view for judgment ofpressure required to operate the said displayed object, a taste view tojudge sense of taste, a temperature view for judging heat generatedduring operation of the said displayed object after certain timeintervals, a touch view for judging the sense of softness touch whenapplied on the displayed object, where the said first realistic 3D-viewis preferably displayed initially, and where the pressure view, thetaste view, the temperature view, the touch view are available, anddisplayed on request as per characteristics, state and nature ofdisplayed object, and where properties of heating, cooling, softness,hardness and pressure applied to open or operate a movable sub-part ofmulti-part 3D-model is represented by texturing the 3D-model indifferent color or texture pattern, where different pressure,temperature, softness or hardness is distinguished at differentsub-parts of said 3D-model or entire 3D-model in different colors ortexture patterns.
 4. The method as in claim 1, wherein input mode isselected from placing a search query to search said object; through apointing device such as mouse; via a keyboard; a gesture guided input ofhand or eye movement captured by a sensor of an system; a touch input; acommand to a virtual assistant sub-system, where command to the saidvirtual assistant system can be a voice command or via chat.
 5. Themethod as in claim 1, wherein extrusive interaction includes rotating3D-model of object in 360 degree in different planes, lighting effect(1103,1104) for light-emitting parts of 3D-model of object, interactingwith 3D-models having electronic display parts for understandingelectronic display functioning, sound effects, and displaying saidobject as per input, with precision, where polygons along withassociated texture of said 3D-model moves as per user command, andmovement of simulated 3D-model or its parts is achieved and displayedwith precision based on user input commands, and where user desiring tooperate a section or part of 3d-model provides input on a section orpart, which is capable of taking the input as in real set-up for thesaid object, where the provided input generates same interactionresponse emulating functioning of said section in real object.
 6. Themethod as in claim 1, wherein the intrusive interactions includesviewing and interacting with internal parts, opening and closing ofsub-parts of said 3d-model, sub-parts change (1101,1102) where thesimulated 3D-model is multi-part object, disintegrating parts of thesimulated 3D-model one by one to interact with interior and individualparts of the said 3d-model, interacting for exploded view, and wherepolygons along with associated texture of said 3D-model moves as peruser command, and movement of 3D-model or its parts is achieved anddisplayed with precision based on user input commands as percharacteristics, state and nature of displayed object.
 7. The method asin claim 1, wherein the time bound changes based interactions comprisesmonitoring or visualizing time-bound changes observed on using oroperating the said 3D-model of object, where object behavior can beascertained after a desired duration.
 8. The method as in claim 1,wherein real environment mapping based interactions comprisesinteractions in which area in vicinity of user is captured, mapped andsimulated in real-time such that simulated 3D-model or virtual objectdisplayed on electronic screen of user can be interacted with the mappedand simulated environment, where environment mapping based interactionsalso include mirror effect of producing reflection of user body or bodypart in mirror part of simulated 3D-model.
 9. A system ofuser-controlled realistic 3D simulation for enhanced object viewing andinteraction experience comprising: a graphical user interface (GUI)(2302) connected to a central search component (2301) configured foraccepting user inputs; a consolidated view displayer (2303) fordisplaying 3D graphics environment, containing one or more 3D-models inan organized manner using a 3D consolidated view generating engine(2306); a 3D-model displayer (2305) for displaying 3D-model of an objectsimulated using a 3D-model generating engine (2307), where the 3D-modeldisplayer comprises at least one display space for displaying thevirtual interactive 3D-model; a virtual operating sub-system (2308) forproviding functionality of operation of displayed 3D-model, where thevirtual operating sub-system is installed during loading of said3D-model as per characteristics, state and nature of displayed object,where the virtual operating sub-system is in direct connection to the3D-model displayer and the 3D objects generating engine; optionally avirtual assistant sub-system (2304) as one input mode for two waycommunication, where the virtual assistant sub-system comprises anothergraphical user interface, a natural language processing component forprocessing of user input in form of words or sentences and providingoutput as per the received input, where the natural language processingcomponent is integrated to a central database (2309); optionally a livetelecast displayer (2312) for displaying live telecast of a placecontaining plurality of objects, where a dynamic link is built over eachidentified object, where each dynamic link invokes the 3D-modeldisplayer for displaying 3D-model of the said identified object;optionally a camera (2311) for capturing video for background mappingbased interaction, where the video captured from the camera is layeredbeneath the 3D-model displayer; where the GUI is direct connection withthe consolidated view displayer, the virtual assistant sub-system, the3D-model displayer, and the central database in addition to the centralsearch component, and where the 3D-model displayer and the 3D objectsgenerating engine are in direct connection to each other, and are alsoconnected to the virtual operating sub-system, and where the centraldatabase is also connected to a central data storage (2310) for storingat least image associated data.
 10. The system as in claim 9, whereinthe 3D-model displayer is an interactive platform for carrying outextrusive interaction and/or intrusive interactions and/or time boundchanges based interaction and/or real environment mapping basedinteractions as per user choice and as per characteristics, state andnature of the said object.
 11. The system as in claim 9, wherein the 3Dobjects generating engine uses image associated data, real objectassociated data, polygon data and texturing data of the said object forsimulating said 3D-model, where the 3D-model comprises plurality ofpolygons.
 12. The system as in claim 9, wherein enhanced object viewingand interaction experience can be provided over a web-page via hypertexttransfer protocol in a wearable or non-wearable display, or as offlinecontent in stand-alone system or as content in system connected tonetwork.
 13. The system as in claim 9, wherein virtual assistantsub-system further includes a microphone for receiving voice command,and a sound output device, where interaction with the said virtualassistant system is two-way communication emulating a user interactingwith real person to gain object related information and receivingprecise replies, either in the form of text output or sound output, asper the query asked.
 14. The system as in claim 9, wherein the linkbuilt over each identified object in the live telecast displayer is adynamic link built in real time during live video telecast of a remoteplace or a link built with a lag time.
 15. The system as in claim 9,wherein real object associated data, polygon data and texturing data ofthe said object is stored in the central database or partially in thecentral data storage.